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(54) Method and apparatus for processing a bit stream 



(57) Apparatus (100. 700) for processing a com- 
pressed input bitstream (112, 712) representing an 
information signal. The apparatus processes the com- 
pressed input bitstream in a way that changes the infor- 
mation signal represented by the compressed input 
bitstream, and comprises a layered decoder (114, 
71 4A) that decodes the compressed input bitstream to 
provide a decoded bitstream (116, 716A), a decoded 
bitstream processor (118, 71 8A) that processes the 
decoded bitstream to provide a modified bitstream (122, 
722A), a layered encoder (124, 724) that re-encodes 
the modified bitstream to provide a compressed output 
bitstream (126, 726). and a selective interconnection 
path (134. 215, 315. 138; 725. 721, 719, 738). The lay- 
ered decoder includes serially-connected decoding 
modules (e.g., 201. 203, 705. 707). The decoded bit- 
stream processor processes the decoded bitstream in a 
way that modifies the information signal. The layered 
encoder includes serially-connected encoding modules 
(e.g., 301 . 303, 705. 707). each of which corresponds to 
one of the decoding modules in the layered decoder. 
The selective interconnection path selectively connects 
the output of one of the decoding modules to the input 
of the decoded bitstream processor and selectively con- 
nects the output of the decoded bitstream processor to 
the input of the one of the encoding modules corre- 
sponding to the one of the decoding modules. The lay- 
ered decoder may include an element that derives 
bitstream parameters from the compressed input bit- 
stream, and the apparatus may additionally comprise a 
bitstream parameter forwarding path that interconnects 
the layered decoder to the layered encoder. At least one 
of the encoding modules may be connected to the 



parameter forwarding path and may perform an encod- 
ing operation using the bitstream parameters derived 
from the compressed input bitstream. 
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Description 

Field of the Invention 

The invention relates to processing brtstreams, and, 
in particular, to processing compressed brtstr earns in a 
way that reduces the resources required to perform the 
processing. 

Background of the Invention 

Brtstr earns representing information signals are 
often subject to compression to conserve communica- 
tions bandwidth or signal storage requirements. For 
example, the bandwidth or signal storage required to 
transmit or store a video brt stream representing a 
motion picture can be reduced by a factor of the order of 
100 by applying suitable spatial and temporal compres- 
sion. Such spatial and temporal compression schemes 
include the MPEG-1 and MPEG-2 schemes standard- 
ized by the ISO. 

Production, distribution and display of video bit- 
streams representing video signals often involves 
processing the video brt stream in some way. Such 
processing may modify the video signal represented by 
the video bitstream. For example, the processing may 
apply color correction or a different gamma correction, 
or may apply noise reduction to the video signal. Such 
processing may additionally or alternatively be per- 
formed to convert the video signal from one video 
standard to another. In this, the number of picture ele- 
ments (pixels) in each picture may be changed, and the 
picture rate may additionally or alternatively be 
changed. Moreover, when the video bitstream is com- 
pressed, the processing may also modify the bitstream 
characteristics of the compressed video bitstream For 
example, the compressed video bitstream may be proc- 
essed to change its bit rate, or to restructure it so that it 
can be decoded using a decoder having a decoder 
buffer of a different size. 

An example of a conventional apparatus 10 for 
processing a compressed input bitstream is shown in 
Figure 1: In this example, the compressed input bit- 
stream is an MPEG-compliant video bitstream. Similar 
arrangements may be used for processing video bit- 
streams compressed according to other standards. In 
the conventional apparatus 10 shown in Figure 1, the 
MPEG decoder 14 decodes the compressed input bit- 
stream 12 to recover the video bitstream 16. The video 
processor 18 applies the processing defined by the 
processing selection block 20 to the video bitstream 16 
to generate the modified video bitstream 22. The modi- 
fied video bitstream is fed to the MPEG encoder 24 that 
generates the compressed output bitstream 26 by reen- 
coding the modified video bitstream to have bitstream 
characteristics, such as bit rate, buffer size, etc.. defined 
by the processing selection block 20. The bitstream 
characteristics of the compressed output bitstream may 



be the same as. or different from, those of the com- 
pressed input bitstream 12. If the processing selected 
by the processing selection block only involves chang- 
ing the bitstream characteristics, the video processor 1 8 

5 simply passes the video bitstream 16 to the MPEG 
encoder 24 without modifying it. 

The encoding operation performed by the MPEG 
encoder 24 on the modified video bitstream 22 is con- 
siderably more computationally intensive than the 

10 decoding operation performed by the MPEG decoder 
14 on the compressed input bitstream 12. For example, 
to encode a video bitstream representing an NTSC 
video signal in real time requires special hardware or a 
computer based on a microprocessor of equivalent 

is computing power to a 686-type microprocessor. Conse- 
quently, the conventional apparatus 10 is complex and 
expensive. 

Of the operations performed by the MPEG encoder 
24, the motion estimation operation used to determine 

20 the motion vector for each block is computationally the 
most intensive. The number of operations required to 
perform motion estimation can be scaled down by 
reducing the scope of the motion search region, or by 
using a fast motion search algorithm, but both of these 

25 approaches inevitably impair video quality. To ensure an 
acceptable video quality, the MPEG encoder 24 will 
encode most sequences using relatively large search 
regions with an efficient but suboptimal, motion estima- 
tion algorithm notwithstanding the large computational 

30 resources that this approach demands. 

What is needed is the ability to perform the above- 
mentioned processing on compressed input brtstreams 
without the need for special hardware, or using a com- 
puter based on a tower-cost microprocessor. What is 

35 also needed is the ability to perform the above-men- 
tioned processing on compressed input brtstreams 
faster than in real time using currently-available hard- 
ware. 

In video production and distribution environments, 

40 the video bitstream may be subject to a number of differ- 
ent processing operations. Multiple processing opera- 
tions are conventionally applied to the video bitstream 
by concatenating a number of processors. Each proces- 
sor operates on the conventional, pixel-level, video bit- 

45 stream generated by the preceding processor. Such an 
arrangement of concatenated processors would replace 
the video processor 18 shown in Figure 1 . 

Using a concatenated arrangement of processors 
to perform multiple processing operations on a video 

so bitstream normally requires that the video bitstream 
operated on by each processor be a conventional video 
bitstream. Processors that operate on compressed or 
partially-compressed video brtstreams cannot be con- 
catenated with processors that operate on conventional 

55 video brtstreams or with processors that operate on 
video bitstreams that are differently compressed. More- 
over, processors that are designed to operate on a con- 
ventional video bitstream, i.e.. on an uncompressed 
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video bitstream, require that computational resources 
be expended to decode the compressed input brtstream 
fully before processing, and to fully re-encode the mod- 
ified brtstream generated by the processors. Finally, 
processing systems that precede the processors by a 
conventional decoder and follow the processors with a 
conventional encoder require the compressed input bit- 
stream to be compressed according to the compression 
standard of the decoder, and provide the output bit- 
stream compressed according to the compression 
standard of the encoder. 

Accordingly, what is also needed is a video 
processing system that allows processors that operate 
on b'rtstreams in different states of compression to be 
concatenated, that can process a compressed input bit- 
stream in any state of compression and that can gener- 
ate a compressed output brtstream in a state of 
compression that is greater than, less than, or the same 
as that of the compressed input brtstream. 

Summary of the Invention 

The invention provides an apparatus for processing 
a compressed input brtstream representing an informa- 
tion signal such as a video signal. The apparatus proc- 
esses the compressed input brtstream in a way that 
changes the information signal represented by the com- 
pressed input brtstream. The apparatus comprises a 
layered decoder that decodes the compressed input bit- 
stream to provide a decoded brtstream, a decoded bit- 
stream processor that processes the decoded brtstream 
to provide a modified brtstream, a layered encoder that 
re-encodes the modified brtstream to provide a com- 
pressed output brtstream, and a selective interconnec- 
tion path. The layered decoder includes serially- 
connected decoding modules. The decoded brtstream 
processor processes the decoded brtstream in a way 
that modifies the information signal. The layered 
encoder includes serially-connected encoding modules, 
each of which corresponds to one of the decoding mod- 
ules in the layered decoder. The selective interconnec- 
tion path selectively connects the output of one of the 
decoding modules to the input of the decoded brtstream 
processor and selectively connects the output of the 
decoded brtstream processor to the input of the one of 
the encoding modules corresponding to the one of the 
decoding modules. 

The invention also provides an apparatus for modi- 
fying the brtstream characteristics of a compressed 
input bitstream representing an information signal. This 
apparatus modifies the brtstream characteristics of the 
compressed input brtstream without necessarily sub- 
stantially changing the information signal represented 
by the compressed input brtstream. The apparatus com- 
prises a controller that provides an output brtstream def- 
inition defining the bitstream characteristics of a 
compressed output bitstream; a layered decoder that 
includes a deriving element that derives brtstream 



parameters from the compressed input bitstream; a bit- 
stream parameter forwarding path; and a layered 
encoder that generates the compressed output bit- 
stream. The layered decoder decodes the compressed 
5 input brtstream to provide a decoded brtstream. The bit- 
stream parameter forwarding path is connected to 
receive the bitstream parameters from the layered 
decoder. The layered encoder is connected to the bit- 
stream parameter forwarding path and re-uses the bit- 
to stream parameters derived from the compressed input 
brtstream to re-encode the decoded bitstream in 
accordance with the output bitstream definition. 

The invention also provides a method for process- 
ing a compressed input bitstream representing an infor- 
is mation signal. The method processes the compressed 
input brtstream in a way that changes the information 
signal represented by the compressed input bitstream. 
In the method, the compressed input bitstream is par- 
tially decoded to provide a decoded bitstream. The 
20 decoded bitstream is a partially- encoded brtstream rep- 
resenting the information signal. A modified bitstream is 
generated by processing the decoded bitstream in a 
way that modifies the information signal. The modified 
brtstream is a partially-encoded brtstream. Finally, the 
25 modified brtstream is re-encoded to generate a com- 
pressed output brtstream. 

The invention further provides a method for modify- 
ing the bitstream characteristics of a compressed input 
bitstream representing an information signal. This 
so method modifies the brtstream characteristics without 
necessarily substantially changing the information sig- 
nal represented by the compressed input bitstream. In 
the method, an output bitstream definition is generated. 
The output bitstream definition defines the brtstream 
35 characteristics of a compressed output brtstream. Brt- 
stream parameters are derived from the compressed 
input bitstream. The compressed input bitstream is at 
least partially decoded to provide a decoded bitstream. 
Finally, the decoded bitstream is re-encoded using the 
40 parameters derived from the compressed input brt- 
stream to generate the compressed output bitstream 
having the brtstream characteristics defined by the out- 
put brtstream def inition. 

The invention also provides an apparatus for 
45 processing a compressed input bitstream representing 
an information signal. The apparatus processes the 
compressed input bitstream in a way that changes the 
information signal represented by the compressed input 
brtstream. The apparatus comprises a first compression 
so state translation unit, a processor and a second com- 
pression state translation unit The first compression 
state translation unit receives the compressed input bit- 
stream as an input bitstream and changes the compres- 
sion state of the compressed input bitstream to 
55 generate an output brtstream The processor receives 
the output bitstream of the first compression state trans- 
lation unit, and processes the output bitstream to gener- 
ate a modif ied bitstream. The processor processes the 
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output bftstream in a way that modifies the information 
signal. The second compression state translation unit 
receives the modified bitstream as an input bftstream 
and changes the compression state of the modified bit- 
stream to generate an output bitstream as the com- 
pressed output bitstream. 

The first and second compression state translation 
units each include layered encoding/decoding modules, 
an input interface module and an output interface mod- 
ule. The input interface module selectively connects the 
input bitstream to one of the encodingAdecodtng mod- 
ules. The one of the encodingttecoding modules to 
which the input bftstream is connected depends on the 
compression state of the input bitstream. The output 
interface module selectively receives a bitstream from 
the output of one of the encoding/decoding modules as 
the output bitstream. The one of the encodings ecocfing 
modules from which the bitstream is received depends 
on the compression state of the output bitstream. The 
compression state of the output bitstream may be differ- 
ent from that of the input bitstream. 

Finally, the invention provides a method for 
processing a compressed input beam representing an 
information signal. In the method, layered encod- 
ing/decoding modules are provided. A first set of encod- 
ing/decoding modules and a second set of 
encodingftiecoding modules are selected from the lay- 
ered encoding modules. The compression state of the 
compressed input bitstream is changed to provide a first 
output bitstream using the first set of encoding/decoding 
modules. The first output bitstream is processed to gen- 
erate a modified bitstream. The first output bitstream is 
processed by in a way that modifies the information sig- 
nal but generates the modified bitstream in the same 
compression state as the first output bitstream. Finally, 
the compression state of the modified bftstream is 
changed using the second set of encoding/decoding 
modules to generate a second output bitstream. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a conventional appa- 
ratus for processing a compressed input bitstream. 
Figure 2 is a block diagram of a first embodiment of 
an apparatus according to the invention for 
processing a compressed input bitstream. 
Figure 3 is a block diagram showing part of the first 
embodiment of the apparatus according to the 
invention in more detail. 

Figure 4 is a block diagram that illustrates how bit- 
stream parameters derived from the compressed 
input bitstream are re-used in the layered encoder 
in the apparatus according to the invention. 
Figure 5 is a flow chart that illustrates a first way in 
which quantizing is performed in the layered 
encoder by re-using quantizing parameters derived 
from the compressed input bitstream. 
Figure 6 is a flow chart that illustrates a second way 



in which quantizing is performed in the layered 
encoder by re-using quantizing parameters derived 
from the compressed input bitstream. 
Figure 7A is a block diagram of a second ernbodi- 

5 merit of an apparatus according to the invention for 
processing a compressed input bitstream. 
Figure 7B is a block diagram showing details of the 
compression state translation units of the second 
embodiment of the apparatus according to the 

10 invention. 

Detailed Description of the Invention 

In the following description, reference will be made 

is to the compression state of an irrformation signal. Bit- 
streams compressed according to MPEG and similar 
compression schemes are the result of a prescribed 
number of layers of compression applied to the original 
information signal. Compressed bitstr earns can also be 

20 generated by applying fewer than the prescribed 
number of layers of compression to the information sig- 
nal. Accordingly, a compressed bitstream representing 
an information signal can be regarded as having a com- 
pression state that depends on the number of layers of 

25 compression that have been applied to the irrformation 
signal. The compression state of a compressed bit- 
stream can be increased by applying additional layers of 
encoding operations to the compressed bitstream, and 
can be decreased by applying layers of decoding oper- 

30 ations to the compressed bftstream. 

A first embodiment 100 of a compressed bitstream 
processing apparatus according to the invention is 
shown in Figure 2. The example shown is adapted for 
processing an MPEG-compliant video bitstream, but 

35 can easily be adapted for processing other types of 
compressed bitstrearns representing irrformation sig- 
nals. The compressed bitstream processing apparatus 
100 is composed of four main units, the layered decoder 
1 14, the decoded bitstream processor 118, the layered 

40 encoder 124 and the bitstream parameter forwarding 
path 1 28 that interconnects the layered decoder and the 
layered encoder. In addition, if the compressed bft- 
stream processing apparatus is designed to allow a 
user to select or def ine the processing operation per- 

45 formed, the apparatus additionally includes the 
processing selection module 120 that receives instruc- 
tions from the user and controls the processing per- 
formed by the layered decoder, the processor and the 
layered encoder. Otherwise, the processing selection 

so module controls the processing performed by the lay- 
ered decoder, the bitstream processor and the layered 
encoder so that the compressed bitstream processing 
apparatus performs a predetermined processing opera- 
tion on the compressed input bitstream. 

55 The layered decoder 114 decodes the compressed 
input bitstream 1 12 to generate the decoded bitstream 
116 and passes the decoded bitstream to the decoded 
bitstream processor 118. The layered decoder gener- 
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ates the decoded bitstream in the compression state 
required by the decoded bitstream processor 1 18. For 
example, when the decoded bitstream processor is a 
conventional bitstream processor that operates on a 
conventional video bitstream, the decoded bitstream is 
a conventional video bitstream. Alternatively, the 
decoded bitstream processor may operate on a par- 
tially-compressed video bitstream, such as a bitstream 
composed primarily of DCT coefficients. In this case, 
the decoded bitstream is composed primarily of DCT 
coefficients. 

The layered decoder 114 additionally derives from 
the compressed input bitstream various parameters that 
will be called bitstream parameters. The bitstream 
parameters are parameters that are extracted from the 
compressed input bitstream 1 12, or that are derived by 
the layered decoder in the course of decoding the com- 
pressed input bitstream. In the following description, the 
term derived will be understood to encompass either of 
these possibilities. The bitstream parameters collec- 
tively define each picture of the video bitstream repre- 
sented by the compressed input bitstream, and include 
coded, quantized DCT coefficients, motion vectors, 
quantizing tables, macroblock-type information, and 
header information. The header information includes 
statistical information such as the number of bits per 
block and the number of bits per picture. The layered 
decoder forwards the bitstream parameters to the lay- 
ered encoder 124 through the bitstream parameter for- 
warding path 128. 

The decoded bitstream processor 118 processes 
the decoded bitstream 1 16 it receives from the layered 
decoder 114, and passes the resulting modified bit- 
stream 122 to the layered encoder 124. The layered 
encoder is also connected to the bitstream parameter 
forwarding path 128 from which it receives the bitstream 
parameters derived from the compressed input bit- 
stream 112 by the layered decoder. The layered 
encoder generates the compressed output bitstream 
126 by wholly or partially re-encocfing the modified bit- 
stream In this embodiment, the extent of the re-encod- 
ing performed by the layered encoder is the same as the 
extent of the decoding performed by the layered 
decoder. 

The layered decoder 1 14 operates only to decode 
the compressed input bitstream 1 12 to the state of com- 
pression required by the decoded bitstream processor 
118. This state of compression is less than that of the 
compressed input bitstream 112, but may be greater 
than that of a conventional video bitstream. In this 
embodiment, the modified bitstream 122 is in the same 
state of compression as the decoded bitstream 116. 
The layered encoder 124 re-encodes the modified bit- 
stream re-using at least some of the bitstream parame- 
ters derived from the compressed input bitstream 112 
by the layered decoder 114. Re-using the bitstream 
parameters saves the layered encoder from expending 
computational resources to calculate new parameters 



equivalent to the bitstream parameters that are re-used. 
Consequently, the compressed bitstream processing 
apparatus 100 according to the invention can perform 
the desired processing of the compressed input brt- 

5 stream using a smaller scale of hardware or a less pow- 
erful computer or digital signal processor than a 
conventional compressed bitstream processing appara- 
tus. Alternatively, compared with a conventional appara- 
tus, the compressed bitstream processing apparatus 

10 according to the invention can perform the desired 
processing at a faster rate, e.g., faster than real-time, 
using given hardware or a given computer. 

The compressed bitstream processing apparatus 
100 will now be described in more detail. In particular. 

is the layered decoder 114 and the layered encoder 124 
will be described in detail with reference to Figures 2 
and 3. 

The layered decoder 1 1 4 will be described first. The 
layered decoder receives the compressed input bit- 

20 stream 112, partially or fully decodes the compressed 
input bitstream, and supplies the resulting decoded bit- 
stream 116 to the decoded bitstream processor 118. 
The layered decoder also derives bitstream parameters 
from the compressed input bitstream and supplies the 

25 bitstream parameters to the layered encoder 1 24 via the 
bitstream parameter forwarding path 128. In the exam- 
ple shown, the compressed input bitstream and the 
compressed output bitstream 126 are both MPEG-com- 
pliant video brtstreams. 

so Like a conventional MPEG decoder, the layered 
decoder 114 includes a number of serially-connected 
decoding modules that operate together to decode the 
compressed input bitstream 112. Unlike a conventional 
MPEG decoder, the layered decoder can stop decoding 

35 the compressed input bitstream at the completion of 
decoding by any one of the decoding modules so that 
the compressed input bitstream is decoded only to the 
compression state required by the decoded bitstream 
processor 1 18. The decoding module at which the lay- 

40 ered decoder stops decoding depends on decoding 
control data supplied by the processing selection mod- 
ule 120 via the control path 132. When the decoding 
control data set the layered decoder so that all the 
decoding modules operate to decode the compressed 

45 input bitstream, the layered decoder decodes the com- 
pressed input bitstream to generate the decoded bit- 
stream 116 as a conventional video bitstream. The 
pictures of a conventional video bitstream are in presen- 
tation order and the bitstream includes a pixel value for 

so each pixel of each picture. When the decoding control 
data set the layered decoder so that fewer than all the 
decoding modules are selected to decode the com- 
pressed input bitstream. the compressed input bit- 
stream is only partially decoded. In this case, the 

55 decoded bitstream 116 is not a conventional video bit- 
stream, but is partially compressed. For example, the 
decoded bitstream may comprise a set of DCT values 
for each block of each picture. 
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Since the layered decoder 114 can stop decoding 
the compressed input bitstream at the completion of 
decoding by any one of the decoding modules, the out- 
put of each decoding module is not only connected to 
the input of the following decoding module, but is also s 
connected to the output bus 134 that feeds the output 
selector 215. The output selector will be described in 
more detail below. 

The decoding modules that constitute the layered 
decoder 1 14 are based on corresponding modules of a 
conventional MPEG decoder. It is assumed that the per- 
son of ordinary skill in this art is familiar with the struc- 
ture and operation of such conventional modules, so the 
decoding modules will only be described briefly. The 
decoding modules include the decoder buffer 201, the 
demultiplexer 203. the inverse variable-length coder 
205, the inverse quantizer 207, the inverse discrete 
cosine transform module 209, the motion compensator 
211 and the spatial bitstream output module 213. 

The compressed input bitstream, a constant bit-rate 
video stream in this example, is temporarily stored in 
the decoder buffer 201. The compressed input bit- 
stream is transferred from the decoder buffer to the 
demultiplexer 203 one picture at a time In response to 
timing control data located in headers embedded in the 
bitstream. The demultiplexer divides the portion of the 
compressed input bitstream relating to each picture into 
its constituent bitstream parameters. The bitstream 
parameters collectively define each picture of the video 
bitstream represented by the compressed input bit- 
stream, and include coded, quantized DOT coefficients, 
motion vectors, quantizing tables, macrobJock-type 
information, color data, and header information. The 
header information includes statistical information such 
as the number of bits per block and the number of bits 
per picture. The decoder bitstream parameter bus 136 
interconnects the output of the demultiplexer with inputs 
of the other decoding modules, and passes the bit- 
stream parameters from the demultiplexer to the other 
decoding modules. The decoding modules each per- 
form a decoding operation using not only the data 
received from one or more preceding decoding modules 
but also the bitstream parameters received via the 
decoder bitstream parameter bus. In addition, the 
decoder bitstream parameter bus is connected to the 
bitstream parameter forwarding module 1 30 to form part 
of the bitstream parameter forwarding path 128. 

The bitstream parameter forwarding module 130 
receives the bitstream parameters from the layered 
decoder 114 via the decoder bitstream parameter bus 
136. The bitstream parameter forwarding module tem- 
porarily stores those of the bitstream parameters that 
will be used by either or both of the decoded bitstream 
processor 118 and the layered encoder 124 until they 
are needed. The bitstream parameter forwarding mod- 
ule also feeds the bitstream parameters to an appropri- 
ate channel of the encoder bitstream parameter bus 
140. The encoder bitstream parameter bus connects 



the bitstream parameters to the encoding modules of 
the layered encoder in which the bitstream parameters 
will later be used to re-encode the modified bitstream 
122. 

The inverse variable length coder 205 receives the 
coded, quantized DCT coefficients from the demulti- 
plexer 203 and reverses the variable length coding 
applied to these coefficients to generate quantized DCT 
coefficients. The quantized DCT coefficients are fed to 
the inverse quantizer 207 and also to the output bus 134 
for connection to the output selector 215. In addition, 
the quantized DCT coefficients may be fed as bitstream 
parameters to the bitstream parameter forwarding path 
128 for forwarding to the layered encoder 124. 

The inverse quantizer 207 receives the quantized 
DCT coefficients from the inverse variable length coder 
205, and also receives the quantizing tables from the 
demultiplexer 203 via the decoder bitstream parameter 
bus 136. The inverse quantizer reverses the quantizing 
applied to the quantized DCT coefficients to generate 
blocks of DCT coefficients. The DCT coefficients are fed 
to the inverse DCT module 209, and also to the output 
bus 134 for connection to the output selector 215. In 
addition, the DCT coefficients may be fed as bitstream 
parameters to the bitstream parameter forwarding path 
128 for forwarding to the layered encoder 1 24. 

The inverse DCT module 209 receives the blocks of 
DCT coefficients from the inverse quantizer 207 and 
applies an inverse discrete cosine transform to the 
blocks of DCT coefficients to generate respective blocks 
of differences. The blocks of differences are fed to the 
motion compensator 211. and also to the output bus 
134 for connection to the output selector 215. In addi- 
tion, the blocks of differences may be fed as bitstream 
parameters to the bitstream parameter forwarding path 
128 for forwarding to the layered encoder 124. 

The motion compensator 21 1 receives the blocks of 
differences from the inverse DCT module 209 and also 
receives respective reference blocks from a recon- 
structed picture stored in a page of a picture memory 
(not shown) in the spatial bitstream output module 213. 
The picture memory selects the respective reference 
blocks from the reconstructed picture in response to the 
motion vectors for the blocks of differences. The picture 
memory receives the motion vectors from the multi- 
plexer 203 via the decoder bitstream parameter bus 
136. The motion compensator adds each difference in 
the block of differences to a corresponding pixel value in 
the reference block to generate a new pixel value of a 
new reconstructed picture block. The motion compen- 
sator feeds the reconstructed picture block to the spatial 
bitstream output module 213. The motion compensator 
also feeds the reconstructed picture block onto the out- 
put bus 134 for connection to the output selector 215. 
The successive reconstructed picture blocks fed to the 
output selector constitute a block-format video bitstream 
in which the pictures are in coding order. Coding order 
differs from presentation order, i.e., the order in which 
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the pictures are presented to the viewer. 

When the block of differences Is a block of a picture 
that has been encoded as a B-picture, the reference 
block may be selected from two reconstructed pictures 
stored in the picture memory. However, to simplify the 
following description, a reference to selecting a block of 
a reconstructed picture will be taken to encompass 
selecting blocks of more than reconstructed picture 
when the picture is decoded or encoded as a B-picture. 

The spatial brtstream output module 213 receives 
each reconstructed picture block from the motion com- 
pensator 21 1 and stores the reconstructed picture block 
in the picture memory as a block of a reconstructed pic- 
ture being constructed in a page of the picture memory. 
This page is different from the page in which the picture 
that supplied the reference block is stored. When all the 
blocks of a reconstructed picture have been stored in 
the picture memory, the reconstructed picture is availa- 
ble for the spatial brtstream output module to read it out 
onto the output bus 134 for connection the output selec- 
tor 215. The spatial brtstream output module reads out 
the reconstructed picture in raster scan format and in 
presentation order as a picture of a conventional video 
brtstream. 

As noted above, the inverse variable-length coder 
205, the inverse quantizer 207, the inverse DOT module 
209, the motion compensator 211 and the spatial brt- 
stream output module 213 operate selectively in 
response to the decoding control data received from the 
processing selection module 120 via the control path 
132. The decoding control data select the decoding 
modules actually used to decode the compressed input 
brtstream. For example, if the user commands the sys- 
tem to perform spatial filtering on the compressed input 
brtstream, and the decoded brtstream processor 1 18 is 
capable of performing such filtering on blocks of DCT 
coefficients, the decoding control data will enable the 
inverse variable-length coder 205 and the inverse quan- 
tizer 207, and will cause the output selector 21 5 to con- 
nect the partially-decoded brtstream from the inverse 
quantizer to the decoded brtstream processor 118 as 
the decoded brtstream 116. The decoding control data 
will also deactivate the decoding modules downstream 
of the decoding module whose output is selected as the 
decoded brtstream 1 16, i.e., the inverse DCT module 
209. the motion compensator 211 and the spatial brt- 
stream output module 213. These decoding modules 
can be deactivated since they are not required to 
decode the compressed input brtstream to the DCT 
coefficient level. This enables computational resources 
that would otherwise be used for these decoding mod- 
ules to be used for other purposes. 

In the layered decoder 1 14. the output selector 215 
is connected to the output bus 134, through which it 
receives the outputs of the decoding modules 201-213. 
The output selector is also connected to the control path 
1 32 through which it receives the decoding control data. 
The output of the output selector is connected to the 



input of the decoded brtstream processor 118. In 
response to the decoding control data, the output selec- 
tor selects the output of one of the decoding modules 
that will serve as the decoded brtstream 116, and feeds 

5 this brtstream to the input of the decoded brtstream 
processor 118. 

It should be noted that when the compressed brt- 
stream processing apparatus 100 according to the 
invention is embodied in a computer or digital signal 

10 processor, the computer or digital signal processor may 
lack elements such as the bitstream parameter forward- 
ing path 128. the brtstream parameter forwarding mod- 
ule 130. the output bus 134 and the decoder bitstream 
parameter bus 136. Instead, for example, the output 

is selector 215 may communicate to the decoded brt- 
stream processor 118 the addresses where the data 
output by the last of the decoding modules to decode 
the compressed input bitstream are stored. The 
decoded brtstream processor can then fetch the data 

20 stored at these addresses and perform the decoded brt- 
stream processing on these data. Similarly, the brt- 
stream parameter forwarding path 128 may 
communicate to the layered encoder 124 the addresses 
at which the brtstream parameters derived from the 

25 compressed input bitstream by the layered decoder are 
stored. The appropriate encoding module of the layered 
encoder 124 can then fetch the bitstream parameters 
stored at these addresses to use them in performing its 
encoding processing. It should also be noted that, in 

so computer-based and DSP-based embodiments, the 
decoding modules may be ephemeral, and the appara- 
tus may lack elements corresponding to those of the 
decoding modules that are not used to decode the com- 
pressed input brtstream 112. 

as The decoded bitstream processor 118 will be 
descrfred next The decoded bitstream processor 
receives the decoded brtstream 116 from the layered 
decoder 1 14 and processes the decoded brtstream to 
generate the modified brtstream 122. The decoded brt- 

40 stream processor can perform any conventional 
processing operation that is not part of the MPEG com- 
pression. These processing operations include color 
correction, seeding, sharpening, noise reduction, etc. In 
the example shown, the processing operation per- 

45 formed by the decoded bitstream processor 1 18 on the 
decoded bitstream 1 1 6 is user specific, and is set by the 
user's input to the processing selection module 120. 

The processing operation performed by the 
decoded bitstream processor 118 depends on the corn- 
so presston state of the decoded brtstream 116. For exam- 
ple, the decoded bitstream processor can perform a 
picture sharpening operation on either the conventional 
video brtstream generated by the spatial brtstream out- 
put module 213 or the DCT coefficients generated by 

55 the inverse quantizer 207. To achieve the desired pic- 
ture sharpening result, the decoded bitstream proces- 
sor win perform a different picture sharpening operation, 
depending on whether the decoded bitstream 1 16 was 
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block-format video brtstream to the motion compensator 
311. 

The motion compensator 31 1 determines a motion 
vector for each macroblock of each picture that will be 
encoded as a P -picture or a B-picture. These pictures s 
are the pictures that will not be independently encoded 
as I -pictures. Conventionally, the motion vector for each 
macroblock is determined by performing a block match- 
ing operation between the macroblock and reference 
blocks selected from one or more reference pictures. 
The reference pictures are usually reconstructed pic- 
tures obtained as a result of the local decoder 317 
decoding the brtstream output by the quantizer 307. The 
reconstructed pictures are stored in a multi-page picture 
memory that forms part of the local decoder. 

In a conventional encoder, the block matching oper- 
ation to determine the motion vectors demands the 
most computational resources of any of the operations 
performed by the encoder. However, the computational 
requirements for determining the motion vectors in the 
compressed brtstream processing apparatus 100 are 
substantially reduced or even eliminated by re-using the 
motion vectors derived from the compressed input bit- 
stream 1 12 by the layered decoder 114 and forwarded 
to the layered encoder via the brtstream parameter for- 
warding path 128. 

The motion compensator 311 additionally proc- 
esses the blocks of the pictures that will be encoded as 
P-pictures and B-pictures to generate difference blocks. 
The blocks subject to this processing will be called pic- 
ture blocks to distinguish them from the reference 
blocks and the difference blocks. The difference block 
for each picture block is obtained by a subtraction oper- 
ation performed between the picture block and a refer- 
ence block. The reference block is the block of the 
reference picture indicated by the motion vector of the 
picture block. 

The motion compensator 31 1 also passes encod- 
ing blocks to the DCT module 309. Encoding blocks are 
picture blocks if the picture is to be encoded as an l-pic- 
ture, and are the difference blocks generated as just 
described if the picture is to be encoded as a P-picture 
or a B-picture. 

The DCT module 309 receives the encoding blocks 
from the motion compensator 311 and orthogonally 
transforms each encoding block from the spatial domain 
to the frequency domain using a discrete cosine trans- 
form. The DCT module passes the resulting blocks of 
DCT coefficients to the quantizer 307. 

The quantizer 307 receives the blocks of DCT coef- 
ficients from the DCT module 309 and quantizes each 
of the DCT coefficients in each block. The quantizing 
step-size is controlled by a buffer occupancy control sig- 
nal (not shown) generated by the encoder buffer 301. 
The quantizing step size is controlled to ensure that the 
encoder buffer and a hypothetical standard video 
decoder buffer neither overflow nor underflow. The 
quantizer passes the resulting blocks of quantized DCT 



coefficients to the variable-length coder 305. 

The variable-length coder 305 receives the blocks 
of quantized DCT coefficients from the quantizer 307 
and applies variable-length coding to the quantized 
DCT coefficients in each block. The variable-length 
coder passes the resulting blocks of coded quantized 
DCT coefficients to the multiplexer 303 and to the local 
decoder 317. 

The multiplexer 303 receives the blocks of coded 
quantized DCT coefficients from the variable-length 
coder 305, and additionally receives parameters such 
as motion vectors from the motion compensator 311, 
quantizing step size information from the quantizer 307, 
and run-length information from the variable-length 
coder 305, and combines these parameters to generate 
a picture-layer video bitstream. The multiplexer passes 
the resulting video bitstream picture-by-picture to the 
output buffer 301. 

The output buffer 301 receives the video brtstream 
from the multiplexer 303 and generates the compressed 
output bitstream 126, a constant bit-rate bit stream. An 
additional multiplexer (not shown) may interleave the 
compressed output bitstream with other brtstreams, 
such as a compressed audio bitstream, and with addi- 
tional header information, to generate a composite out- 
put bitstream. 

The spatial brtstream input module 313, the motion 
compensator 311, the DCT module 309, the quantizer 
307 and the variable-length coder 305 operate selec- 
tively in response to the encoding control data received 
from the processing selection module 120 via the con- 
trol path 142. The encoding control data determine 
whether each of the above modules will actually oper- 
ate. For example, if the user desires to perform spatial 
filtering on the compressed input brtstream, and the 
decoded bitstream processor is capable of performing 
such f Storing on DCT coefficients, the encoding control 
data will enable the quantizer 307 and the variable- 
length coder 305 and will cause the input selector 315 to 
connect the partially-compressed modified bitstream 
122 from the decoded brtstream processor 118 to the 
input of the quantizer 307. The encoding control data 
will also deactivate the encoding modules upstream of 
the encoding module that receives the modified brt- 
stream, i.e., the DCT module 309, the motion compen- 
sator 311, the spatial brtstream input module 313 and 
the focal decoder 317. Deactivating the unused encod- 
ing modules frees computational resources that would 
otherwise be used to provide these modules to be used 
for other purposes. 

It should be noted that when the compressed bit- 
stream processing apparatus according to the invention 
is embodied in a computer or digital signal processor, 
the computer or digital signal processor may lack such 
elements as the input bus 138 and the encoder brt- 
stream parameter bus 140. In this case, the input selec- 
tor 315 may communicate the addresses at which the 
decoded brtstream processor 118 stored the modified 
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brtstream 122 to the first of the encoding modules to 
process the modified brtstream. This encoding module 
will then fetch the modified brtstream from these 
addresses. Similarly, the bitstream parameter forward- 
ing module 130 may communicate to the layered 
encoder 124 the addresses at which the brtstream 
parameters derived from the compressed input bit- 
stream 1 12 by the layered decoder 1 14 are stored. Trie 
layered encoder can then fetch the bitstream parame- 
ters stored at these addresses to use them in connec- 
tion with encoding the mocfified bitstream. It should also 
be noted that in computer-based and DSP-based 
embodiments, the encocfing modules may be ephem- 
eral, and the apparatus will lack elements correspond- 
ing to the encoding modules that are not used to encode 
the modified bitstream 122. 

Some of the ways in which the bitstream parame- 
ters derived from the compressed input bitstream 1 12 
by the layered decoder 114 can be used will now be 
described. In a first example, the bitstream parameters 
derived from the compressed input bitstream are for- 
warded to the decoded bitstream processor 118 where 
they are used to simplify the processing performed by 
the decoded bitstream processor. The bitstream param- 
eters are color data indicating the color characteristics 
of the video signal represented by the compressed input 
bitstream. Such color data are included in the picture 
headers derived from the compressed input bitstream 
by the demultiplexer 203. The demultiplexer forwards 
the color data to the decoded bitstream processor 1 18 
via the brtstream parameter forwarding path 128. The 
decoded brtstream processor then uses the color data 
to determine whether it needs to apply color correction 
to the decoded bitstream 116. If the decoded bitstream 
processor determines that color correction is needed, it 
may additionally use the color data to design an appro- 
priate color calibration scheme. 

The layered decoder 1 1 4 decodes the compressed 
input bitstream 112 to generate the decoded bitstream 
116 in a compression state suitable for processing by 
the decoded bitstream processor 1 18. The decoded brt- 
stream processor then applies color correction to the 
decoded bitstream using the color calibration scheme it 
has derived from the color data derived from the com- 
pressed input bitstream. The layered encoder 124 then 
re-encodes the modified bitstream 122 generated by 
the decoded bitstream processor 118 to generate the 
compressed output bitstream 126. The video signal rep- 
resented by the compressed output bitstream is color 
corrected relative to that represented by the com- 
pressed input bitstream. Additional bitstream parame- 
ters derived from the compressed input bitstream 112 
may be used by the layered encoder to simplify the 
encoding processing required to re-encode the modified 
bitstream 122. as win be descrfoed below. 

As noted above, in conventional MPEG compres- 
sion, the motion estimation operation of the encoding 
process requires the most computational resources. 



Motion estimation is conventionally performed using a 
motion compensator module located in the encoder in a 
position corresponding to that of the motion compensa- 
tor 31 1 in the layered encoder 124. Consequently, elim- 

5 inating or substantially simplifying the motion estimation 
operation can achieve substantial savings in the compu- 
tational resources required by the layered encoder 124. 

The motion compensator 311 can be completely 
disabled rf the decoded bitstream processor 118 can 

10 perform the processing operations selected by the user 
using the DCT coefficients derived from the com- 
pressed input bitstream 112 by the layered decoder 
1 14. This provides a substantial reduction in the compu- 
tational resources demanded by the layered encoder. 

15 However, rf the processing operation performed by the 
decoded bitstream processor 118 requires that the lay- 
ered decoder fully decode the compressed input bit- 
stream to provide a conventional video bitstream as the 
decoded bitstream 1 1 6. then the modified brtstream 122 

20 is a conventional video bitstream that has to be fully re- 
encoded. 

The compressed bitstream processing apparatus 
1 00 provides a number of ways of reducing the compu- 
tational resources required to re-encode the modified 

25 bitstream when the modified bitstream is a conventional 
video bitstream. The bitstream parameter forwarding 
path 128 forwards the motion vectors derived from the 
compressed input bitstream 1 12 to the layered encoder 
124. The layered encoder can then use these motion 

so vectors as the motion vectors in the motion compensa- 
tion operations performed by the motion compensator 
31 1 . This provides a significant reduction in the compu- 
tational resources required by the layered encoder 124. 
since no motion estimation operations are performed. 

35 Re-using the motion vectors derived from the com- 
pressed input brtstream constrains the performance of 
the motion estimation in the layered encoder to be no 
better than that originally used to encode the com- 
pressed input bitstream. However, this is not usually a 

40 significant drawback since most hardware or software 
encoders employ an effective although efficient motion 
estimation algorithm. 

Simply re-using the motion vectors derived from the 
compressed input bitstream 1 12 will produce an accept- 

45 able motion estimation accuracy, but a better motion 
estimation accuracy is obtained by using the motion 
vectors derived from the compressed input bitstream as 
full-pixel motion vectors, and performing an additional 
half-pixel search relative to the full-pixel motion vectors 

so to produce the final motion estimation. This alternative 
demands more computational resources than re-using 
the motion vectors derived from the original com- 
pressed input bitstream. However, it produces a better 
picture quality and a better compression efficiency. 

55 Moreover, since the scope of the motion estimation 
search is considerably less than that used in conven- 
tional motion estimation, the additional computing 
resources required are substantially less than those 
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stream has been processed. 

The computational resources required for the sec- 
ond approach are also reduced by using bitstream 
parameters derived from the compressed input bit- 
stream to enable the adaptive bit allocation of the com- 
pressed input brtstream to assist in controlling the bit 
rate of the compressed output brtstream. The process- 
ing performed in the second approach is illustrated in 
Figure 6. Steps S1 , S2, S4-S6, and S9 are the same as 
in the first approach described above with reference to 
Figure 5, and will not be described again here. 

In step S3, the layered decoder 114 derives the bit- 
stream parameter mb inco ^ff{k] each macroblock of the 
compressed input brtstream 112 and forwards this bit- 
stream parameter to the quantizer 307 in the layered 
encoder 124 via the brtstream parameter forwarding 
path 128. The brtstream parameter rnb tncaet ^k] indi- 
cates the number of non-zero DCT coefficients in the 
current macroblock k of the compressed input bit- 
stream. 

In step S5A. the layered decoder 114 forwards the 
quantized DCT coefficients derived from the com- 
pressed input bitstream 112 by the inverse variable- 
length coder 205 to the quantizer 307 via the brtstream 
parameter forward ng path 128. 

In step S7, the quantizer 307 in the layered encoder 
124 uses the bitstream parameter nib inco ^f{k] to deter- 
mine the number of the quantized DCT coefficients 
received from the layered decoder that will be set to 
zero to control the bit rate of the compressed output bit- 
stream. The quantizer calculates the value of 
mb outcoo d[k) for the current macroblock k. The value of 
mb outcoof ^k] is the number of DCT coefficients in the 
macroblock k that may have a value other than zero. To 
calculate the value of rnb outcoof ^k] for the current mac- 
roblock *. the quantizer multiplies the value of the bit- 
stream parameter mb inco9f f[k] by the value of the 
conversion factor f[k] calculated in step S6, i.e., 

In step S8, the quantizer 307 receives all the quan- 
tized DCT coefficients of the current macroblock k from 
the inverse variable-length coder 205, and sets to zero 
all but the number of them indicated by the value of 

mboutcoodkl 

In the embodiment just described, the compressed 
input signal and the compressed output signal were 
both MPEG-compliant brtstreams. An example of a sec- 
ond embodiment 700 of a compressed bitstream 
processing apparatus according to the invention wOl 
now be described with reference to Figures 7A and 7B. 
This embodiment operates on a compressed input bit- 
stream in any compression state, generates the com- 
pressed output bitstream in any compression state, end 
allows multiple processors operating on brtstreams hav- 
ing different compression slates to be concatenated. In 
the example to be described, the compressed brtstream 



processing apparatus processes a compressed input 
brtstream representing a video signal. 

The compressed bitstream processing apparatus 
700 is composed of four basic units, the first compres- 
5 sion state translation unit 714. the final compression 
state translation unit 724. the processor 71 8A, and the 
bitstream parameter forwarding path 728 that includes 
the bitstream parameter forwarding module 730. If the 
compressed bitstream processing apparatus is 
w designed to allow a user to select or define the process- 
ing operation performed, the apparatus additionally 
includes the processing selection module 720 that 
receives instructions from the user and controls the 
processing performed by the compression state transla- 
te ton units and the processor. Otherwise, the processing 
selection module controls the processing performed by 
the compression state translation units and the proces- 
sor so that the compressed bitstream processing appa- 
ratus performs a predetermined processing operation 
so on the compressed input bitstream 

The example shown in figure 7A includes two 
optional additional units, the compression state transla- 
tion unit 71 4B and the second processor 71 8B. These 
additional units provide the compressed bitstream 
25 apparatus 700 with the capability to process the infor- 
mation signal represented by the compressed input bit- 
stream in two different ways, a first way performed by 
the first processor 71 8A and a second way performed 
by the processor 71 8B. The compression state transla- 
te tion unit 71 4B precedes the optional second processor 
718B. and the two units are interposed between the first 
processor 718A and the final compression state transla- 
tion unit 724. The compression state translation unit 
71 4B and the second processor are also connected to 
35 the bitstream parameter forwarding path 728 and are 
controlled by the processing selection unit 720. 

Preceding the second processor 718B with the 
compression state translation unit 71 4B enables the 
second processor to operate on a bitstream having a 
40 different compression state from the bitstream output by 
the first processor 718A. Optionally, more than one 
additional processor, each preceded by a compression 
state translation unit, may be interposed between the 
first processor 71 8A and the final compression state 
45 translation unit 724. 

In the example shown in f igure 7 A, the video signal 
represented by the compressed input bitstream 712 is 
subject to two different processing operations, one per- 
formed by the first processor 71 8A and the other per- 
50 formed by the second processor 718B. The first 
processor is preceded by the compression state trans- 
lation unit 71 4 A. which changes the compression state 
of the compressed input bitstream to generate the out- 
put bitstream 71 6A in the compression state required by 
55 the first processor. The first compression state transla- 
tion unit enables the compressed input brtstream 712 to 
have a compression state that differs from that required 
by the first processor. 
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The first processor 71 8A processes the output bit- 
stream 71 6A generated by the compression state trans- 
lation unit 71 4A to generate the modified bttstream 
722A. The first processor modifies the video signal rep- 
resented by the output bttstream 716A, but does not 
change the compression slate of the output bttstream. 
Consequently; the compression state of the modified 
bttstream 722A is the same as that of the output bit- 
stream 716A. Optionally, the first processor 714A may 
be composed of multiple concatenated processors, all 
of which operate on bitstreams in the same compres- 
sion state. 

The second processor 718B is preceded by the 
compression state translation unit 71 4B, which changes 
the compression state of the modified bitstream 722A to 
generate the output bitstream 71 6B in the compression 
state required by the second processor. The compres- 
sion state translation unit 71 4B enables the second 
processor to be concatenated with the first processor 
71 8A, even though the processors operate on input bit- 
streams having differing compression states. 

The second processor 71 8B processes the output 
bitstream 71 6B generated by the compression state 
translation unit 714B to generate the modified bitstream 
722B. The second processor modifies the video signal 
represented by the output bitstream 71 6 B, but does not 
change the compression state of the output bitstream. 
Consequently, the compression state of the modified 
bitstream 722B is the same as that of the output bit- 
stream 71 6B. Optionally, the second processor may 
also be composed of multiple concatenated processors, 
ail of which operate on bitstreams in the same compres- 
sion state. 

The second processor 718B is followed by the final 
compression state translation unit 724, which changes 
the compression state of the modified bitstream 722B to 
generate the compressed output signal 726. This ena- 
bles the compressed bitstream processing apparatus 
700 to deliver the compressed output signal in the 
desired compression state. The final compression state 
translation unit may also change the bttstream charac- 
teristics, e.g., bit rate, buffer size, etc., of the modified 
bitstream to generate the compressed output bttstream 
with the desired bitstream characteristics. The com- 
pression state and bitstream characteristics of the com- 
pressed output signal may be the same as, or different 
from, that of the compressed input bitstream 712. 

Figure 78 shows details of the compression state 
translation unit 714 having the same structure and oper- 
ation as the compression state translation units 71 4A, 
71 4B and 724 of the embodiment shown in Figure 7A. 
The compression state translation unit 714 receives the 
input bitstream 712 in a first compression state, selec- 
tively changes the compression state of the input bit- 
stream to generate the output bitstream 716 having a 
different compression state from the input bttstream. 
The compression state of the output bitstream may be 
greater than or less than that of the input bitstream, i.e.. 



the compression state translation unit 714 may operate 
in an encoding mode or a decoding mode, depending 
on the control data received via the control path 732. 
The compression state translation unit 714 is com- 

5 posed of three main modules, the input interface 719, 
the output interface 721, and the layered encod- 
ing/decoding modules 723. The layered encod- 
ing/decoding modules are composed of an 
encoding/decoding module corresponding to each com- 

io pression state of the compressed input bitstream. In the 
example shown, the layered encoding modules are the 
variable length coding/decoding module 705, the quan- 
tizing/inverse quantizing module 707, the orthogonal 
transform module 709 and the motion compensa- 

15 tion/spatial processing module 71 1 . 

The input interface module 719 includes buffering 
and demultiplexing elements (not shown) that derive bit- 
stream parameters from the input bitstream 712. The 
input interface module selectively feeds the bitstream 

20 parameters to those of the layered encoding/decoding 
modules 723 that require them via the input bus 738. 
The input bus enables the input interface module to feed 
bitstream parameters to any of the encoding/decoding 
modules. The control data received via the control path 

25 732 determine which of the encodingAdecoding mod- 
ules receive the bitstream parameters from the input 
bus. 

The input interface module 719 also feeds the bit- 
stream parameters to the bitstream parameter forward- 
so ing bus 736 for forwarding to the processors 71 8A and 
718B and to other compression state translation units 
via the bitstream parameter forwarding path 728. The 
control data received via the control path 732 determine 
which of the bitstream parameters are fed to the bit- 
35 stream parameter forwarding bus 736. 

The bitstreams generated by the layered encod- 
ingAdecoding modules 723 are fed to the data output 
bus 725. These bitstreams are composed of such data 
elements as pixel values, motion vectors, coded, quan- 
40 tized DCT coefficients, etc. The data output bus trans- 
fers these bitstreams to an encocfing/decoding module 
of a higher or lower layer, and also to the output inter- 
face module 721. 

The output interface module 721 includes multiplex- 
45 ing and buffering elements (not shown) that construct 
the output bitstream 716 from the bitstreams generated 
by one or more of the layered encodingAdecoding mod- 
ules 723. The output interface module can select the bit- 
stream output by any of the encoding/decoding 
so modules for inclusion in the output bitstream. The out- 
put interface module selects the encoding/decoding 
modules from to receive a bitstream for inclusion in the 
output bitstream in response to the control data 
received via the control path 732. 
55 The layered encodingAdecoding modules 723 are 
all dual-function modules. Each of the modules is capa- 
ble of operating in an encoding mode or in a decoding 
mode, depending on the control data received via the 
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control path 732. For example, when the control data 
Get the orthogonal transform module 709 to its encoding 
mode, this module performs both forward and reverse 
discrete cosine transforms, the inverse transforms 
being required to provide part of the local decoding 
function of an encoder. When the control data set the 
orthogonal transform module to its decoding mode, this 
module only performs inverse discrete cosine trans- 
forms. 

The control data received via the control path 732 
also select the encoding/decoding modules required to 
provide the compression state translation unit with its 
desired compression state translation characteristic. 
The control data may select all of the encoding/decod- 
ing modules, or a subset of the encodingAdecotfng 
modules, depending on the compression states of the 
input and output bitstr earns. 

In a computer- or DSP-based compressed bit- 
stream processing apparatus, the control data received 
via the control path 732 also determine the allocation of 
computational resources to each of the layered encod- 
ing/decoding modules 723. The compression state 
translation unit performs a partial encoding or decoding 
operation using a subset of the layered encod- 
ing/decoding modules. Normally, in this case, no com- 
putational resources are allocated to the remaining, 
unused encoding/decoding modules. 

Each of the encodingAdecoding modules 723 oper- 
ates on a bitstream output by either the input interface 
module 71 9 or the encodingftJecocfing module in at least 
one higher or lower processing layer. Each of the 
encoding/decoding modules outputs a bftstream to the 
output interface module 721 or to the encoding/decod- 
ing module in at least one higher or lower processing 
layer. The bitstr earn routing among the encod- 
ing/decoding modules and between the input and out- 
put interface modules 719 and 721 and the 
encoding/decoding modules is determined by the con- 
trol data received via the control path 732. Whether a 
bitstream is output to a encoding/decoding module in a 
higher layer or a lower layer depends on whether the 
compression state translation unit is operating in its 
encode mode or its decode mode, respectively. 

In addition, the layered encoding/decocfing modules 
723 may operate using bftstream parameters received 
via the bftstream parameter forwarding path 728, and 
the layered encocBng/decodlng modules may addition- 
ally or alternatively derive bitstream parameters from 
the compressed input bitstr earn and forward such bit- 
stream parameters to the other compression state 
translation units and the processors via the bftstream 
parameter forwarding path 728. 

A first practical example of a compression state 
translation unit will now be described. In this example, 
the compression state translation unit is the first com- 
pression state translation unit 714A of a compressed 
bitstream processing apparatus in which the first proc- 
essor 71 8A operates on a partially-compressed bit- 



stream composed of DCT coefficients. In this example, 
the input bftstream 712 of the first compression state 
translation unit is an MPEG bitstr earn, and the first com- 
pression state translation unit operates to decode the 

5 MPEG bitstream to the compression state required by 
the first processor. 

Control data received via the control path 732 
cause the compression state translation unit 71 4A to 
operate in the following way: the variable-length cod- 

w ing/decoding module 705 operates in its variable-length 
decoding mode, the quantizing/inverse quantizing mod- 
ule 707 operates in its inverse quantizing mode and the 
remaining encoding/decoding modules are disabled. No 
computational resources are allocated to the disabled 

is encoding/decoding modules. 

The input interlace module 719 derives coded, 
quantized DCT coefficients, quantizing tables, motion 
vectors, picture headers and other bitstream parame- 
ters from the input bitstream 712. Using the input bus 

zo 738. the input interface module feeds the DCT coeffi- 
cients to the variable-length decoding module 705. the 
quantizing tables to the inverse quantizing module 707, 
and the motion vectors and picture headers to the out- 
put interface module 721. Using the bitstream par am e- 

25 ter forwarding bus 736, the input interface module also 
feeds the quantizing tables, motion vectors, picture 
headers and other bitstream parameters derived from 
the input bitstream to the bitstream parameter forward- 
ing path 728 and to the output interface module 721 . 

so The output interface module 721 receives via the 
output bus 725 the bftstream of DCT coeff icients output 
by the inverse quantizing module 707. The output inter- 
face module receives via the forwarded bitstream 
parameter bus 736 a bitstream composed of the 

35 respective picture headers and motion vectors from the 
input interface module 719. The output interface module 
forms the output bitstream 716 from the DCT coeffi- 
cients and the respective picture headers and motion 
vectors. 

40 The bftstream parameters derived from the input 
bftstream 712 by the first compression state translation 
unit 71 4A are forwarded via the bitstream forwarding 
path 728 to the first and second processors 718A and 
718B for use in processing the output bitstream gener- 

45 ated by the compression state translation unit 71 4A. 
The bftstream parameters are also forwarded via the bft- 
stream forwarding path 728 to the compression state 
translation units 714B and 724 for possible use in re- 
encoding the modified bitstreams generated by the first 

so and second processors. 

A second practical example of a compression state 
translation unit will now be described. In this example, 
the compression state translation unit is again the first 
compression state translation unit 71 4 A of a com- 

55 pressed bitstream processing apparatus 700 in which 
the first processor 71 8A operates on a partially-com- 
pressed bitstream composed of DCT coefficients. In this 
second example, the input bftstream 712 is a partially 
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compressed brtstream composed of pictures in coding 
order, and in which each picture is composed of a set of 
encoding blocks. Encoding blocks are picture blocks 
composed of a pixel value for each pixel when the pic- 
ture is a l-picture, and are difference blocks composed 5 
of a difference value for each pixel when the picture is a 
P- or B-picture. In the latter case, each encoding block 
has a respective motion vector. The compression state 
translation unit operates 71 4A to encode the partially- 
compressed input brtstream to change the compression 10 
state of the input brtstream to that required by the first 
processor. 

Control data received via the control path 732 
cause the compression state translation unit 71 4 A to 
operate in the following way: the orthogonal transform is 
module 709 operates in its forward transform mode, and 
the remaining encoding/decooSng modules are disa- 
bled. No computational resources are allocated to the 
disabled encoding/decotfng modules. 

The input interface module 719 derives the encod- 20 
ing blocks, motion vectors and other brtstream parame- 
ters from the input bitstream. Using the input bus 725, 
the input interface module feeds the encoding blocks to 
the orthogonal transform module 709. The input inter- 
face module also feeds the motion vectors and other bit- 2s 
stream parameters derived from the input bitstream to 
the bitstream parameter forwarding bus 736 for forward- 
ing to the bitstream parameter forwarding path 728 and 
to the output interface module 721 . 

The output interface module 721 receives via the so 
output bus 725 the bitstream of DCT coefficients output 
by the orthogonal transform module 709. The output 
interface module also receives via the bitstream param- 
eter forwarding bus a bitstream composed of the 
respective motion vectors for the DCT coefficients from 35 
the input interface module 719. The output interface 
module forms the output bitstream 716 from the DCT 
coefficients and respective motion vectors. 

Again, the brtstream parameters derived from the 
input bitstream 71 2 by the first compression state trans- <o 
lation unit 71 4A are forwarded via the brtstream forward- 
ing path 728 to the first and second processors 718A 
and 71 8B for use in processing the output bitstream 
generated by the compression state translation unit 
71 4A. The brtstream parameters are also forwarded via 45 
the brtstream forwarding path 728 to the compression 
state translation units 714B and 724 for possible use in 
further changing the compression state of the modified 
bitstreams generated by the first and second proces- 
sors. 50 

In both examples just described, forwarding the bit- 
stream parameters from the first compression state 
translation unit 71 4A saves the compression state 
translation units 71 4B and 724 from expending compu- 
tational resources to generate new parameters equiva- bs 
lent to the bitstream parameters forwarded by the 
compression state translation unit 714A. Consequently, 
the compressed brtstream processing apparatus 700 



according to the invention can perform the desired 
processing of the compressed input bitstream using a 
smaller scale of hardware or a less powerful computer 
or digital signal processor than a conventional com- 
pressed information signal processing apparatus. Alter- 
natively, compared with a conventional processing 
apparatus, the compressed brtstream processing appa- 
ratus 700 can perform the desired processing at a faster 
rate, e.g., faster than real-time, using given hardware or 
a given computer. 

Although this disclosure describes illustrative 
embodiments of the invention in detail, it is to be under- 
stood that the invention is not limited to the precise 
embodiments described, and that various modifications 
may be practiced within the scope of the invention 
def ined by the appended claims. 

Claims 

1 . Apparatus (1 00. 700) for processing a compressed 
input bitstream representing on information signal, 
the apparatus comprising: 

a layered decoder (1 14; 714) that decodes the 
compressed input bitstream (112, 712) to pro- 
vide a decoded bitstream (1 16, 716A), the lay- 
ered decoder including serially-connected 
decoding modules (e.g., 201, 203, 705. 707), 
each having an output; 

a decoded bitstream processor (118, 71 8A) 
that processes the decoded brtstream in a way 
that modifies the information signal to provide a 
modified bitstream (122, 722A), the decoded 
bitstream processor having an input and an 
output; 

a layered encoder (124, 724) that re-encodes 
the modified bitstream to provide a com- 
pressed output brtstream (126, 726), the lay- 
ered encoder including serially-connected 
encoding modules (e.g., 301. 303; 705, 707), 
each of the encoding modules having an input, 
each of the encoding modules corresponding 
to one of the decoding modules of the layered 
decoder; and 

a selective interconnection path (134, 215, 
315, 138; 725. 721, 719, 738) that selectively 
connects the output of one of the decoding 
modules to the input of the decoded brtstream 
processor and that selectively connects the 
output of the decoded brtstream processor to 
the input of one of the encoding modules, the 
one of the encoding modules corresponding to 
the one of the decoding modules. 

2. The apparatus of claim 1, additionally comprising 
means (120, 132, 142; 720, 732) for deactivating 
the decoding modules downstream of the one of 
the decoding modules, and for deactivating the 
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encoding modules upstream of the one of the 
encoding modules. 

3. The apparatus of claim 1 or 2. in which: 

5 

the layered decoder includes deriving means 
(e.g., 203; 712) for deriving brtstream parame- 
ters from the compressed input bitstream; 
the apparatus additionally comprises a bit- 
stream parameter forwarding path (128, 728) io 
that interconnects the layered decoder to the 
layered encoder; and 

at least one of the encoding modules is con- 
nected to the parameter forwarding path and 
performs an encoding operation using the bit- is 
stream parameters derived from the com- 
pressed input bitstream by the deriving means. 



the layered encoder re-uses the brtstream 
parameters to re-encode the modified bit- 
stream. 

7. The apparatus of claim 6, in which: 

the decoded bitstream processor is additionally 
connected to the brtstream parameter forward- 
ing path (128. 728); and 
the decoded brtstream processor processes 
the decoded bitstream in response to the bit- 
stream parameters derived from the com- 
pressed input bitstream by the deriving means. 

8. A method for processing a compressed input bit- 
stream representing an information signal, the 
method comprising: 



4. Apparatus (100, 700) for modifying brtstream char- 
acteristics of a compressed input bitstream repre- 
senting an information signal, the apparatus 
comprising: 

a controller (120, 720) that provides an output 
bitstream definition defining brtstream charac- 
teristics of a compressed output brtstream; 
a layered decoder (114, 71 4A) that decodes 
the compressed input brtstream (112, 712) to 
provide a decoded bitstream (116, 716A), the 
layered encoder including deriving means 
(e.g.. 203, 719) for deriving brtstream parame- 
ters from the compressed input bitstream; 
a bitstream parameter forwarding path (128. 
728) connected to receive the bitstream 
parameters from the layered decoder; 
a layered encoder (124, 724) connected to the 
bitstream parameter forwarding path and that 
re-uses the bitstream parameters derived from 
the compressed input bitstream by the deriving 
means to re-encode the decoded brtstream in 
accordance with the output bitstream definition 
to provide the compressed output bitstream. 

5. The apparatus of claim 4, in which the decoded bit- 
stream is partially encoded relative to the informa- 
tion signal. 

6. The apparatus of claim 4 or 5. in which: 

the apparatus additionally comprises a 
decoded brtstream processor (118, 71 8A) con- 
nected to receive the decoded bitstream (1 16, 
716) and to provide a modif ied bitstream (122, 
722A) to the layered encoder in lieu of the 
decoded bitstream (1 16, 716). the decoded bit- 
stream processor processing the decoded bit- 
stream in a way that modifies the information 
signal; and 



partially decocting the compressed input brt- 
20 stream (112) to provide a decoded bitstream 

(1 16). the decoded bitstream being a partially- 
encoded bitstream representing the informa- 
tion signal; 

generating a modified bitstream (122) by 
25 processing the decoded bitstream in a way that 

mocfifies the information signal, the modified 
bitstream being a partially-encoded bitstream; 
and 

re-encoding the modified bitstream (122) to 
so generate a compressed output brtstream (1 26). 

9. The method of claim 8, in which: 

the method additionally comprises deriving brt- 
35 stream parameters from the compressed input 

bitstream; and 

the modified bitstream (122) is re-encoded 
using the bitstream parameters derived from 
the compressed input bitstream. 

40 

10. A method for modifying the bitstream characteris- 
tics of a compressed input bitstream representing 
an information signal, the method comprising: 

45 generating an output bitstream definition defin- 

ing bitstream characteristics of a compressed 
output bitstream; 

deriving bitstream parameters from the com- 
pressed input bitstream (1 12); 
so at least partially decoding the compressed 

input bitstream to provide a decoded bitstream 
(116); and 

re-encoding the decoded bitstream using the 
bitstream parameters derived from the com- 
55 pressed input bitstream to generate the com- 

pressed output bitstream (126) having the 
bitstream characteristics defined by the output 
bitstream definition. 
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11. The method of ciaim 10, in which the brtstream 
parameters derived from the compressed input bit- 
stream are bitstream parameters generated using 
targe computational resources. 

s 

12. The method of claim 10 or 11, in which: 

the method additionally comprises processing 
the decoded bitstream (116) to generate a 
modified bitstream (122), the decoded bit- to 
stream being processed in a way that modifies 
the information signal; and 
the modified brtstream is re-encoded in lieu of 
the decoded bitstream to generate the com- 
pressed output brtstream, the modified bit- is 
stream being re-encoded using the brtstream 
parameters. 

13. The method of claim 10. 11 or 12. in which the 
decoded bitstream is processed in response to the 20 
bitstream parameters. 

14. Apparatus (700) for processing a compressed input 
bitstream representing an information signal, the 
compressed input bitstream having a compression 25 
state, the apparatus comprising: 

a first compression state translation unit (71 4A) 
that receives the compressed input brtstream 
(712) as an input bitstream and changes the so 
compression state of the compressed input brt- 
stream to generate an output bitstream (71 6 A); 
a processor (71 8A) that receives the output bit- 
stream of the first compression state transla- 
tion unit, processes the output bitstream in a ss 
way that modifies the information signal, and 
provides a modified bitstream; and 
a second compression state translation unit 
(724) that receives the modified bitstream as 
an input bitstream and changes the compres- 40 
sion state of the modified bitstream to generate 
an output bitstream (726). the first and second 
compression state translation units each 
including: 

45 

layered encoding/decoding modules (e.g., 
705. 707, 709. 71 1), each having an input 
and an output 

an input interface module (719) that selec- 
tively connects the input bitstream to one so 
of the encodingAdecocfing modules, the 
one of the encoding/decoding modules 
depending on the compression state of the 
input bitstream, and 

an output interface module (721) that ss 
selectively receives a bitstream from the 
output of one of the encoding/decoding 
modules as the output bitstream. the one 



of the encoding/decoding modules 
depending on the compression state of the 
output brtstream. 

15. The apparatus of claim 14, additionally comprising 
means for deactivating ones of the encod- 
ing/decoding modules not required to change the 
compression state of the input brtstream. 

16. The apparatus of ciaim 14 or 15. in which: 

the first compression state translation unit 
includes means for deriving bitstream parame- 
ters from the input brtstream; 
the apparatus additionally comprises a param- 
eter forwarding path (728) that interconnects 
the first compression state translation unit and 
the second compression state translation unit; 
and 

at least one of the encoding/decoding modules 
of the second compression state translation 
unit is connected to the parameter forwarding 
path and performs an encocfing operation using 
the brtstream parameters derived from the 
compressed input bitstream. 

17. A method for processing a compressed input bit- 
stream representing an information signal, the com- 
pressed input bitstream (712) having a 
compression state, the method comprising: 

providing layered encoding/decoding modules 
(e.g..705. 707.709. 711); 
selecting a first at of encocfing/deooding mod- 
ules and a second set of encoding/decoding 
modules from the layered encoding modules; 
changing the compression state of the com- 
pressed input bitstream (712) using the f irst set 
of encoding/decoding modules to provide a first 
output bitstream (71 6A); 
processing the first output bitstream to gener- 
ate a modified bitstream (722A), the first output 
bitstream being processed by in a way that 
mocfifies the information signal but generates 
the modified bitstream in the same compres- 
sion state as the first output bitstream; and 
changing the compression state of the modified 
bitstream using the second set of encod- 
ing/decoding modules to generate a second 
output bitstream (e.g.. 71 6B. 726). 

1& The method of claim 17. additionally comprising: 

selecting one of an encoding mode and a 
decoding mode for the encoding/decoding 
modules of the first set; and 
selecting one of an encoding mode and a 
decoding mode for encoding/decoding mod- 
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19. The method of claim 17 or 18, in which: 

the method additionally comprises deriving bit- 6 
stream parameters from the compressed input 
brtstream; and 

the compression state of the modified bit- 
stream is changed using the brtstream parame- 
ters derived from the compressed input 10 
brtstream. 

20. The method of claim 17. 18 or 19, in which: 

the method additionally comprises deriving bit- is 
stream parameters from the compressed input 
brtstream; and 

the first output brtstream is processed using the 
brtstream parameters derived from the com- 
pressed input brtstream. 20 
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